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The fundamental matrix and trifocal tensor are convenient algebraic representations of the epipolar geometry of two and three view 
configurations, respectively. The estimation of these entities is central to most reconstruction algorithms, and a solid understanding 
of their properties and constraints is therefore very important. The fundamental matrix has 1 internal constraint which is well 
understood, whereas the trifocal tensor has 8 independent algebraic constraints. The internal tensor constraints can be represented 
in many ways, although there is only one minimal and sufficient set of 8 constraints known. In this paper, we derive a second set 
of minimal and sufficient constraints that is simpler. We also show how this can be used in a new parameterization of the trifocal 
tensor. We hope that this increased understanding of the internal constraints may lead to improved algorithms for estimating the 
trifocal tensor, although the primary contribution is an improved theoretical understanding. 
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1. Introduction 

It is well known that a reconstruction from projection con- 
straints alone is, at best, ambiguous up to an arbitrary projec- 
tive transform having 15 degrees of freedom (dof). Each camera 
matrix has 11 dof, so there are 11m - 15 dof to the projective- 
invariant geometry (henceforth referred to as epipolar geome- 
try) of m unique cameras [1, sec. 17.5]. 

In the case of 2 views, the epipolar geometry has 7 dof and 
may be conveniently represented by the 3 x 3 fundamental ma- 
trix F. The additional 2 parameters in the matrix F may be 
attributed to an ambiguous overall scale factor and a single in- 
ternal constraint that rankF = 2. This is usually relaxed to 
rankF < 2, making it equivalent to detF = 0, which can be 
written as a simple polynomial. 

Similarly, the geometric relationship between three views 
can be conveniently represented by a 3 x 3 x 3 tensor known 
as the trifocal tensor and denoted by T. Again by the argument 
above, it is clear that the epipolar geometry of three views has 
18 dof, although the tnesor T has 27 parameters. Thus, not all 
tensors represent consistent epipolar geometry. One parameter 
may be attributed to the overall scale factor, meaning that a ge- 
ometrically valid tensor must satisfy 8 independent algebraic 
constraints. 

The constraints on corresponding lines in three views were 
first derived for calibrated cameras in [2, 3]. These constraints 
were generalized to the uncalibrated case in [4], and formulated 
in terms of a trifocal tensor in [5-7]. It was shown in [8] that 
point constraints could also be represented using the tensor. 

Estimation of the trifocal tensor has become an integral 
part of many projective reconstruction algorithms, for example 



[9, 10], so these constraints are of considerable interest. How- 
ever, unlike the case with the fundamental matrix, the trifocal 
constraints are not so straightforward and are still not fully un- 
derstood [11-13] [l,sec. 15.1]. 

A set of 32 necessary and sufficient constraints were derived 
in [14], and a diff'erent set of 12 necessary and sufficient con- 
straints were derived in [15]. In [16], the first minimal set of 8 
constraints were derived. 

In this paper, we derive a new class of constraints that can 
be taken with 5 previously known constraints to yield a much 
simpler set of minimal constraints. This is a very satisfying 
theoretical finding and we believe it may be the last type of 
constraint that exists. We also show how these new constraints 
can be used to parameterize the tensor, and finally discuss how 
a sufficient set of constraints can be formulated as fixed poly- 
nomials if desired. 



2. Definition of the Tensor 

Let us begin with a definition of the tensor as described in 
[1]. Without loss of generality, the first projection matrix can 
be assumed canonical, so that the set of projection matrices for 
three views can be written as 



P = [I|0] 

F = [ai...a4] = [A|a4] 
r' = [bi...b4] = [B|b4]. 



(1) 
(2) 
(3) 
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The tensor will be derived based on a correspondence be- 
tween images of a line in 3D space. Let the three corresponding 
lines in the image plane be denoted as 1 1' 1''. The back 
projection of each line yields a plane. 
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Because the lines were all images of a single 3D line, these 
back-projected planes must all intersect in a single 3D line 
which we write parametrically as a linear combination of two 
points Xi and X2, 



x(0 = tXi + (1 - 0X2. 



(7) 
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Figure 1 . Diagram of trifocal line constraints. The first camera center is denoted 
by C. A parametric 3D line in space is given by X(t). This line projects onto 
the first image plane as 1. The line 1 back-projects to the plane n. Notation is 
similar with respect to the other two views. 



This incidence relation is diagrammed in Fig. 1. Clearly, 
X(t) must be a point on each back-projected plane equation, so 



7i^X(t) = n'^Xit) = 7i''^X(t) = 0. 



(8) 



If we concatenate these planes into a 4 x 3 matrix M = 
[TrlTr^Tr''], then M"^X(0 = 0, which implies M"^Xi = and 
M^X2 = 0. Thus, M has a 2-dimensional null space and must 
be rank 2 from the rank-nullity theorem. Substituting (4-6) into 
M, we obtain 



= rVA^i -1 VB^r. 

Introducing the notation \ = (li^hJs)^ and 

T, = a/bj - a4b[, 
it can be verified that (12) is equivalent to 

/, = VTiV V/. 



(11) 
(12) 



(13) 



(14) 



Thus, the relationship between cameras has been completely 
described by {Ti,T2,T3}. These three matrices, known as the 
correlation slices, can be represented by a single 3x3x3 ten- 
sor T (see Fig. 2), allowing the above relations to be written 
equivalently in tensor notation as 



T: 



(15) 
(16) 




Figure 2. Trifocal tensor parameters as a cube. 

It should be noted that, similarly to the fundamental matrix, 
the views are treated asymmetrically by the trifocal tensor. In 
other words, there are three diff'erent trifocal tensors for any trio 
of views depending on the order that the views are considered 
in. In the remainder of this work, we assume an implicit order- 
ing of these views. 



M = [mi|m2|m3] = 



AT B'l 



Ti// 



(9) 



Because M is of rank 2, it follows that the first column can 
be written as a linear combination of the second two columns, 
so mi = am2 + fim^ . From the bottom row we obtain. 



o = aaJr-hySbJr, 



(10) 



-kailV for some scalar k. 



which implies that a = khlV and ft ■ 
Making these substitutions back into the top half of M provides 
a homogeneous equivalence constraint between the lines. 



3. Relationship to Camera Matrices 

Because the trifocal tensor provides a complete description 
of the epipolar geometry for three views, it must be possible 
to calculate a suitable set of camera matrices from the tensor. 
However, it is not immediately obvious how one could factor 
a given tensor into the form of (13) to get back the original 
camera matrices. In this section, we explain how this may be 
accomplished, as described in [1]. 

We begin by calculating the epipoles e' and e'\ which are the 
images of the focal point of the first camera in the other two 
views. This is achieved in two steps. First, denote the left and 
right null spaces of each T/ as V/ and U/ in 
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T,v, = 0, i=1...3 (17) 
T^u.-^O, i=1...3. (18) 

Next, denote U = [ui|u2|u3]^ and V = [vi|v2|v3]^. Then 
the epipoles (images of the first camera center in the other two 
images) are given by the null spaces of U and V, 

Ue' = (19) 
Ve'' = 0. (20) 

Once the epipoles have been determined, one can recover the 
fundamental matrix between the first two views. Recall that the 
tensor was defined based on a correspondence between lines 
1 r V in each image. If the third line V back projects 
into a plane 7t'\ then this plane induces a planar-homography 
mapping the first line 1 to the second line V. 

A homography that transfers points according to = Hx 
transfers lines according to V = H"^l. According to this defini- 
tion, (14) implies that the homography transferring a line from 
the first to the second image induced by a line in the third image 
is given by 

Hi2 = [Ti,T2,T3r, (21) 

where the notational convention of writing A[B, C, D]E is used 
as a shorthand for [ABE|ACE|ADE]. 

Given a point x in the first view, it is therefore transferred to 
x' = H12X in the second view. The line between two points is 
given by the cross product, so the epipolar line 1^ corresponding 
to X is given by 

i; = e'x[Ti,T2,T3]rx. (22) 

Thus, the fundamental matrix F12 from the first to the second 
view is given by 

Fi2 = [e1x[Ti,T2,T3r. (23) 

This formula holds for any V as long as V is not in the null 
space of any T/. One choice that avoids this degeneracy is e''. 
Thus, we obtain 

Fi2 = [e']x[Ti,T2,T3y. (24) 

It is known that the fundamental matrix corresponding to a 
pair of cameras given by P = [I|0] and P' = [M|m] is equal 
to [m]xM. Therefore, a suitable choice for the first two camera 
matrices consistent with the tensor are 

P = [I|0] (25) 
r = [[Ti,T2,T3K|e1. (26) 



The third camera matrix can now be determined from (13). 
Using the notation of (3), 

a, = T,e", /=1...3 (27) 
a4 = (28) 
b4 = e'' (29) 

and substituting into (13) we obtain 

T,- = Tie''e''^ - e'hj (30) 
e'bj = T,(eV^ - I). (31) 

If we choose the scale of e' such that e'^e' = ||e"|| = 1, then 
we can left multiply by e'^ to get 

hj = e'^Ti(e''e''^ - I) (32) 

b, - = (e''e''^ - l)Tje\ (33) 

Thus, a consistent choice for the third camera matrix is given 

by 

= [(e''e''"^ - I)[t|, T^, T^]e'|e'']. (34) 

4. Previously Known Constraints 

Because the tensor has 27 free parameters but the epipolar 
geometry that it represents has only 18 degrees of freedom, it 
is clear that there are dependencies between the tensor param- 
eters. These dependencies are the internal constraints, and one 
must verify that an estimated tensor satisfies all such constraints 
or else the tensor would not consistently encode for any mean- 
ingful geometry. 

The derivation of constraints on the trifocal tensor has been 
a long and arduous process. The first known constraints are the 
three rank constraints (3rd order) and two epipolar constraints 
(5th order) [8, 14, 15], which are fairly straight-forward to iden- 
tify from the definition. 

The first set of sufficient constraints is due to [14], where the 
27 axes constraints were derived. These are 6th order polyno- 
mial constraints, but they are all independent from the existing 
rank and epipolar constraints. Thus, a total of 32 constraints 
were needed at that time. 

It was later shown in [15] that there are a set of 10 ex- 
tended rank constraints (3 of which are equivalent to the orig- 
inal rank constraints). These are 3rd order, and independent 
from the epipolar constraints. Thus, together with the epipolar 
constraints, a total of only 12 constraints were needed. 

Finally, [16] showed that 8 new constraints (of up to 12th 
degree) could be derived based on the concept of generalized 
eigenvalues. This is the only minimal set of necessary and suffi- 
cient constraints that is currently known. However, a somewhat 
unsatisfactory property of these constraints is that they are not 
so simple as the well known rank and epipolar constraints. 
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4.1. Rank and Epipolar Constraints 

The rank and epipolar constraints are a set of 5 independent 
constraints on the tensor that have been known for some time 
[8, 14, 15]. It is not hard to spot these constraints from inves- 
tigation of (17-34). Specifically, in order for the null spaces in 
(17-18) to exist, it is clear that each T/ must be of rank 2. This 
may also be deduced from the fact that T/ was defined as the 
sum of two outer products in (13). Thus, the first three con- 
straints may be taken as. 



rank T/ = 2, / = 1 . . . 3. 



(35) 



These are the rank constraints. They arise as a direct result 
of the assumption that, for corresponding lines, they must back- 
project into planes that intersect in a common 3D line. 

Similarly, in order for the epipoles to exist as null spaces in 
(19-20), the rank of the matrix of left null vectors, as well as 
the rank of the matrix of right null vectors, must be 2. Thus, an 
additional two constraints, called the epipolar constraints, are 
given by 



rank U ■ 
rank V ■ 



:2 
:2. 



(36) 
(37) 



These simply enforce the property that all projection rays 
emanating from one camera's focal point must intersect at a 
common epipolar point in the image plane of another camera. 
In other words, it enforces the equations of perspective projec- 
tion. 

Constraints of the form rankM = 2 on 3 x 3 matrices are 
usually treated as being equivalent to det M = to be enforced 
as polynomials. However, it should be noted that degenerate 
matrices having rank < 2 do not represent valid trifocal tensors, 
although the inequality constraint that rank > 1 does not aff'ect 
the dof . 

4.2. Axes Constraints 

There are 27 axes constraints [14, 17], 9 for each dimen- 
sion of the tensor. These are 6th degree polynomials in the 
tensor elements, independent from the rank and epipolar con- 
straints. Recall that the trifocal tensor elements are indexed as 
T-^ where /, /, k index the correlation slice, row, and column 
dimensions, respectively. 

In order to denote these constraints, we introduce the nota- 
tion that an asterisk in any dimension means all the values in 
that dimension will be collected into a column vector. In other 
words, 7^*^ denotes the ^th column of the /th correlation slice 
T/, Tf denotes the transpose of the yth row of T/, and 7"/^ de- 
notes the column vector formed by taking the (7, ^)th element 
from each correlation slice. 

Without further ado, the vertical constraints are 



\q-ik q-il (J-jll Icj-ik q-jk q-jA 

?-'*'''* * '''* 5-'* 

\Ti\ Ti', rj'l Irf , r/*, ri'l 



(38) 
(39) 



the horizontal column constraints are 



Ir?—*/: <j~*l n~*l\ \n~*k rr'*k n~*l\ 

r i ' ^ / ' ^ ; I r / ' ^ j ' ^ i I 
\rr"^k <j~*l a~*l\ \a~*k r7~*k n~*l\ _ f) 

and the horizontal row constraints are 



\r7~k* r7~l* n~l*\ \n~k* rr'k* n~l*\, 
r / ' ^ / ' ^ 7 I r / ' ^ 7 ' 7 I 
\crk* rj-l* <7~^*| \n~k* n~k* a~l*\ 
r 7 ' i ' 7 \ \ i ' 7 ' i I 



0, 



(40) 
(41) 



(42) 
(43) 



where /, 7, ^, / e {1, 2, 3} and / < j and k < I. Note that commas 
have been used in the above equations to denote the merging of 
three columns together to form a 3 x 3 matrix. 

4.3. Extended Rank Constraints 

It is known that any linear combination of the tensor slices 
must also have rank 2. Specifically, if x = (xi,X2, x^)^ then 



rank 



(44) 



Geometrically, if x is a point in the first image then the left 
and right null spaces of 2? -^/T/ are the corresponding epipolar 
lines in the second and third views, respectively [1]. 

The requirement that all linear combinations have rank 2 can 
be translated into a set of 10 algebraic constraints called the ex- 
tended rank constraints [15, 17] as follows. The rank constraint 
in (44) implies a zero determinant, which can be expanded to 
the polynomial 

det^ x/T/ = cixl -\- C2x\ + C3X3 
^ + + csx\x^ 

+ c^x^xi + cjx^x^ (45) 

+ CsX^Xi + C9X3X2 

+ C1QX1X2X2 = 0. 

In order for this polynomial to be zero for all choices of x, 
it must be the case that the coefficients c/ = V/. These are 
the ten extended rank constraints. The first three coefficients 
are q = det T/ for / = 1 ... 3, so these are just the original rank 
constraints, but the remaining 7 are independent from the basic 
rank and epipolar constraints. They may be expanded to 



(46) 
(47) 
(48) 
(49) 
(50) 
(51) 

(52) 



C4 = 








=0 


C5 = 






^\T;\Tf-,Tf\ 


=0 
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=0 


Cl = 








=0 
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\n\T;\Tf\ 






=0 


C9 = 








=0 


C\Q = 


|r;',r-rf| 






+ 










=0. 



4 



4.4. Generalized Eigenspace Constraints 

It was shown in [16] that a minimal set of 8 necessary and 
sufficient constraints for a trifocal tensor could be derived by 
ensuring that the generalized eigenspaces between each pair of 
tensor slices intersect in a common point, and that there exists 
a common one-dimensional generalized eigenspace of all pairs. 
Specifically, the following conditions must be satisfied: 

1. The polynomial det(T2 - XI \) must have a single root X\ 
and double root /I2, and rank(T2 - /I2T1) = 1. 

2. The polynomial det(T3 - yuTi) must have a single root ii\ 
and a double root and rank(T3 - ii2l\) = 1. 

3. If a, b, a\ W are the generalized eigenvectors correspond- 
ing to the eigenvalues A\, A2, /d\ and /12 (respectively), then 
a oc a'. 

These constraints are not independent from any of the pre- 
vious constraints. The requirement that a oc a' amounts to 
checking for equality between two inhomogeneous 2-vectors 
and therefore provides two algebraic constraints. 

In order for a 3rd degree polynomial 



p{A) = a?i -\-bA -\-cA-\-d 
to have a double root, it must be the case that 



- 4AC = 0, 

where A = - 3ac, B = be - 9ad and C 
case, the roots are given by 



Ai = B/A - b/a 
A2 = -B/(2A). 



(53) 



(54) 
3bd. In this 



(55) 
(56) 



The two conditions of this type therefore provide two con- 
straints. In terms of the tensor elements, the coefficients of 
det(T2 - All) are 3rd degree, A,B,C are 6th degree, and the 
double root constraint is therefore 12th degree. 

The constraint rank(T2 - /i2Ti) = 1 is equivalent to 



(T2 -/l2Ti)(axb) oc Tia, 



(57) 



(and similarly for the second pair). These requirements provide 
the final four constraints. 



5. New Circular Constraints 

Clearly, there must exist a set of 3 constraints that can be 
supplanted with the well-known rank and epipolar constraints 
to yield a minimal set of necessary and sufficient constraints. 
This set would likely be simpler and preferable for the purpose 
of constrained estimation than the generalized eigenspace con- 
straints which are rather complicated. However, the identifica- 
tion of those constraints has remained an open problem until 
now. 



Specifically, we will show that the final 3 constraints can be 
obtained by substituting the recovered camera matrices from 
(26) and (34) back into (13). This may at first seem like circu- 
lar logic because the camera matrices were derived from (13). 
However, the presence of singular outer-product matrices pre- 
vents the resulting equations from being simplified down to a 
trivial result such as I = I, and real constraints arise. We will 
refer to these as the circular constraints. 

In Section 3 we have already derived 



a,- = T,e'', / = 1 . . . 3 (58) 

a4 = e' (59) 

b[ = e'"^T,(e''e''"^ - I), / = 1 . . . 3 (60) 

b4 = e'', (61) 

which can be substituted back into (13) to obtain 

T, = T,e"e""^ - eXe'"^T,(e"e""^ - I)) (62) 
= T,(e"e"^ - I) - e'e'^T,(e"e"^ - I) (63) 
= (I - e'e'"^)TKe''e''"^ - I). (64) 

Because outer product matrices and T/ are all singular, noth- 
ing further can be canceled out. However, one must be careful 
because this result was derived under the assumption that the 
epipoles were normalized, and only holds under that assump- 
tion. Thus, it may be generalized to 



= (||e'|pI-eV^)T,-(eV^-||e''|pI). 



(65) 



Because (65) is a 3 x 3 matrix equation which holds for each 
choice of / = 1 ... 3, it provides a total of 27 constraints that 
must be satisfied by T in order to remain consistent with our 
definitions. We will first explain our findings pertaining to the 
independence of these constraints. 

To begin with, we denote the individual constraint equations 
arising from the matrix equation (65) as cf, ijk e {1,2,3} 
corresponding to the (7, ^)th equality using T/. Our first finding 
is that these constraints are not trivially satisfied, and that they 
are independent from the rank and epipolar constraints. Sec- 
ondly, constraints on are independent from constraints on Tj 
for / j. Thus, from the counting argument, it can be inferred 
that if any constraint cf is satisfied, then cf V jk are satisfied. 
These two findings are written formally as 



det U = A 
det V = A 
det T; = V/ 



(Cf = 0) ^ (cf = OVyl) V/, 



(66) 
(67) 



and proven in Section 5.2. Therefore, one choice of the final 
three independent constraints may be taken as Cp Vl Assuming 
the epipoles have been normalized, Cp expands to 



e'/e^Xe^' - DT^.^' + (1 - ef )(1 - e^^)7:^^ + e'^e'^(e',' - l)T^+ 

62636^ ^2^?^ ^2^3(^2 ~ l)*^-^^ + ^2^3^2 ^3 '^■^^ ~ ^' 

/ 6 {1,2,3}, 

(68) 

where the elements of the first epipole are denoted by e' = 
(Cp 63)^, and similarly for e". 

5.7. New Parameterization 

Having identified the final circular constraints, it becomes 
possible to directly solve for the basis vectors of the compo- 
nents of a geometrically valid trifocal tensor, suggesting a rather 
elegant new parameterization for the tensor by simply using the 
coordinates in these bases. 

Specifically, four parameters can be used to describe the in- 
homogeneous coordinates of the epipoles and e''. The epipo- 
lar constraint demands that the null spaces of U and V be the 
epipoles. Thus, if the elements of U are arranged into the col- 
umn vector u, then it must satisfy 



where a,b,c,. . .J are the coefficients of (68). 

Although there are 7 constraints, there is a linear dependency 
between the first 6 so the dimension of the null space is 3. The 
first slice Ti can be represented with 2 parameters due to the 
overall scale ambiguity, but the remaining two slices require 3 
parameters because they cannot be scaled independently. Thus, 
a total of 22 parameters are used to represent the tensor under 
this parameterization. 

We now describe the reverse mapping for representing a 
given tensor in this parameterization. First, the epipoles are 
computed from the null spaces as shown in (17-20). If the ten- 
sor is not perfectly consistent, these null spaces may not exist so 
they should be extracted using the right singular vector, which 
provides a least squares estimate of a basis for the null space. 

Once the epipoles have been found, the first four parameters 
are given by their inhomogeneous coordinates. Then the con- 
straint matrix can be formed and the basis B^^ can be found. 
The coordinates p^^ of U with respect to this basis may be found 
by solving a linear least squares system, 



C„u = 0, (69) 
where is a 3 x 9 constraint matrix given by 













Cu = 





















The space of all u satisfying this constraint is given by find- 
ing a basis B^^ for the null space of using Gauss- Jordan elim- 
ination. Because there are 9 parameters and 3 constraints, there 
is a 6 dimensional basis for the null space. One must be care- 
ful, however, to avoid the singular condition that arises if U has 
rank 1 . This can be enforced by ensuring that each coordinate 
in the basis is non-zero. Also, the overall scale is irrelevant, so 
the last coordinate can be assumed equal to 1 and therefore U 
can be represented with 5 parameters (and similarly for V). 

The rank constraint demands that the left and right null 
spaces of each T/ are defined by and V/. This provides six 
constraints on each T/. A seventh constraint is given by the 
circular constraint Cp, and once again, the space of matrices 
satisfying these constraints is described by a basis for the null 
space of the constraint matrix. 

To be precise, if the desired left and right null spaces of the 
slice Ti are U/ = (ui , U2, u^y and V/ = (vi , V2, vs)^, then the 7 x 9 
constraint matrix is 



U\ 








U2 








M3 











U\ 








U2 



















Ui 


















Vl 




V3 





























Vl 


V2 































Vl 


V2 


V3 


a 


h 


c 


d 


e 


/ 


g 


h 


i 



B,p, = u. (72) 

After solving for it should be normalized such that the last 
coordinate is equal to 1 in order to reduce the parameterization. 
The same process can be used to obtain the coordinates for V, 
as well as each slice T/ of the tensor. 



5.2. Proof 



Our derivation of the circular constraints given in (65) shows 
that these 27 equalities must be true for internal consistency, al- 
though we have not yet proven our claims in (66-67). In other 
words, we have not yet proven that these equalities are not im- 
plied by the rank and epipolar constraints, and that the subset in 
(68) are mutually independent. 

If we assume that the circular constraints are dependent on 
the rank and/or epipolar constraints and then find a tensor that 
satisfies all the rank and epipolar constraints without satisfying 
the circular constraints, then we have reached a contradiction. 
Thus, finding such a tensor would prove that the circular con- 
straints are, in general, independent from the rank and epipolar 
constraints. 

It is easy to find an unlimited number of counter-examples of 
this type by using our parameterization in Section 5.1 to gener- 
ate a random tensor that satisfies all constraints except for the 
circular constraint by simply omitting the last row from C^. It 
can then be verified that the circular constraints are not satis- 
fied. For example, we have used Maple with rational arithmetic 
to find the following tensor: 
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357500/180469 200/251 475/251 

1500/719 3 (73) 

1700/719 2 1 

2050000/961197 200/401 1100/401 

8000/2397 1 4 (74) 

1500/799 3 

950000/480799 400/401 1100/401 

2500/1199 5 . (75) 

4500/1199 4 1 



It may be verified that the above tensor slices are rank 2 (rank 
constraints). Extracting their null spaces and arranging them to 
form U and V, we obtain 



U 



-251/100 
-401/100 
-401/100 

-719/500 
-799/500 
-1199/500 



5/4 
2 
2 

6/5 
4/3 
2 



(76) 



(77) 



Again, these matrices are exactly rank 2 (epipolar con- 
straints). Extracting their null spaces yields the epipoles, 



e' = (100,200,1)"^ 
e'' = (-500, -600, 1)"^. 



(78) 
(79) 



Finally, we evaluate (65) and observe that none of the circu- 
lar constraints are zero. For brevity, we print only the values of 
the central constraints. 



cf = 



-101022670792200/1834807869906823 (80) 
-5236581973887/55211191885087 (81) 
-14516209041800/698318420372419. (82) 



Thus, the tensor in (73-75) is not a valid trifocal tensor, and 
the circular constraints are indeed independent from the rank 
and epipolar constraints. 

Proving that the three central constraints are independent 
from one another is trivial from the design of our algorithm for 
consistently parameterizing the tensor. Specifically, one notices 
that once U and V have been calculated, there are no further de- 
pendencies between the matrices. Thus, it is not possible for 
Cp to have any dependency on C^^ for / j. 

Having proven that Cp V/ are mutually independent, and also 
independent from the rank and epipolar constraints, it can be 
seen from the counting argument that all degrees of freedom of 
the tensor have been accounted for. This proves our claim in 
(67). Indeed, if the circular constraint is added back into in 
this example, then it can be verified that all of the constraints in 
(65) are satisfied exactly. 



5.3. Polynomial Form 

The rank, extended rank, and axes constraints are all formu- 
lated as polynomials on the tensor elements already. The epipo- 
lar constraints can also be written as polynomials on the tensor 
elements by expressing the null vectors and in terms of the 
tensor elements. 

A basis for the null space of any n x n matrix having rank 
n - I can be computed in closed form by eliminating a row or 
column and taking (n - I) x (n - 1) sub-determinants. Once 
the null spaces are known, it is straight forward to plug these 
into the rule of Sarrus. Because each element of U and V is 
quadratic in the tensor elements, and the determinant of a 3 x 3 
is cubic in the elements, the epipolar constraints are therefore 
5th degree. 

However, it is often forgotten that it is necessary to eliminate 
a row or column that is linearly dependent on another row or 
column; otherwise, a zero vector will be extracted rather than 
a basis for the null space. Replacing any U/ with a zero vec- 
tor only means that det U = will be trivially satisfied. Thus, 
the particular polynomial that must be enforced by the 2 epipo- 
lar constraints must be chosen after identifying which rows are 
linearly independent. 

Alternatively, the epipolar constraints could be translated 
into a larger set of equivalent polynomial constraints by con- 
sidering all rank 2 possibilities of the T/ matrices. In particular, 
since only two of the three rows or columns will be linearly in- 
dependent, it would be necessary to consider two possibilities 
for each T/. This leads to 2^ possible choices for each of and 
e", so the 2 epipolar constraints can be represented by 16 fixed 
polynomial constraints. 

The elements of and e'' can be extracted in closed form 
using the same techniques, and their elements will be 4th de- 
gree polynomials because they are constructed from 2x2 
determinants of a matrix having quadratic elements. Exam- 
ining (68), the order of the circular constraints is therefore 
4-h4-h4-h4-hl = 17. 

The circular constraints are only trivially satisfied if both e' 
and e'' are zero vectors, so an incorrect choice about which rows 
or columns of T/ are linearly independent would make the con- 
straints in (68) appear to be violated, when they might actually 
be satisfied. Thus, it does not appear to be possible to enforce 
them as a set of fixed polynomials. However, the extended rank 
or axes constraints could be used instead to make a sufficient 
set of fixed polynomials, if that were desired for some reason. 

6. Conclusions 

The primary contribution of this paper is an increased un- 
derstanding of the trifocal tensor by deriving the 3 remaining 
constraints that can be combined with the well known rank and 
epipolar constraints to provide a minimal set of necessary and 
sufficient constraints. This is a very satisfying discovery from a 
theoretical standpoint, and also has practical applications such 
as allowing for the new parameterization that we discuss. 

To recapitulate, there are now four known sets of sufficient 
constraints that may be used to define a trifocal tensor, two of 
which are minimal. In order of discovery, they are 
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1 . 3 rank + 2 epipolar + 27 axes 

2. 2 epipolar + 10 extended rank 

3. (minimal) 8 generalized eigenvalue 

4. (minimal) 3 rank + 2 epipolar + 3 circular. 

The newly found circular constraints were derived by a cir- 
cular substituion; from the definition of the tensor, the general 
form for camera matrices was calculated and then substituted 
back into the definition of the tensor. This resulted in constraint 
equations that were nontrivially satisfied only because of the 
existence of rank 1 outer product matrices that prevented the 
equation from being simplified down to I = I. 

Thus, the new constraints do not particularly represent any 
new geometrical restrictions, but are simply another result of 
algebraic consistency required from the original constraint that 
corresponding lines must back-project into planes that intersect 
in a common line in 3D space. 
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